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(57)Abstract: 

PROBLEM TO BE SOLVED: To provide a face picture 
recognizing device and its method, by which a face 
picture is recognized with high precision by preventing 
an illegal action in the case of authentication. 
SOLUTION: This device is provided with a picture input 
part 1 1 for inputting the picture of a person to be 1 
recognized, a face area detecting part 12 for extracting a 
face area in the picture, a face part extracting part 14 
for calculating featured values which indicate an 
individual difference in the face of the person to be 
recognized based on information concerning the face 
area, a person recognizing part 15 for calculating a 
similarity degree between the featured values and the 
featured values previously registered in a register 
information holding part 16 and recognizing the person to 
be recognized and a unit control part 18 for controlling 
whether a prescribed operation is permitted or not based 
on the recognition result. 
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[0035] The face direction determination unit 13 prepares templates corresponding to 
the face directions such as right, left, top, bottom and oblique, made from a face image 
of a number of persons in advance, for whole face region extracted in the face region 
detection unit 12, and estimates which direction the face is facing. It is also possible to 
employ a method for detecting the position of face parts as described in Japanese Patent 
Application Publication No. 09-1471 19. 

[0062] In other words, when using with an ID card or a personal identification number 
etc., if the dictionary of the authentication target person is specified, a "face direction 
easily detected" registered in the dictionary is adapted. If the face direction 
determination unit 13 recognizes that the face of the authentication target person cannot 
be detected or the person is facing the direction registered as "face direction difficult to 
detect", the guide output unit 17 gives an instruction to face the "face direction easily 
detected". 
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* NOTICES * 

JPO and NCI PI are not responsible for any 
damages caused by the use of this translation. 

1. This document has been translated by computer. So the translation may not reflect the original 
precisely. 

2. **** shows the word which can not be translated. 
3.1n the drawings, any words are not translated. 



CLAIMS 



[Claim(s)] 

[Claim 1] In the face image recognition equipment which recognizes a recognition candidate's face 
image and judges the propriety of actuation of a controlled object based on the recognition result 
concerned Extract the above-mentioned recognition candidate's face image, and the characteristic 
quantity which shows the individual difference of the face image concerned is calculated. Face 
image recognition equipment characterized by providing the control means which measures the 
characteristic quantity concerned and the characteristic quantity held beforehand, specifies the 
above-mentioned recognition candidate, and judges the propriety of actuation of a controlled object 
based on the specific result concerned. 

[Claim 2] An image input means to input a recognition candidate's image, and a face field extract 
means to extract a recognition candidate's face field in the image obtained through the above- 
mentioned image input means, A characteristic quantity extract means to calculate the 
characteristic quantity which shows the individual difference of a recognition candidate's face based 
on the information concerning the face field extracted by the above-mentioned face field extract 
means, A registration information maintenance means to store beforehand the characteristic 
quantity which shows the individual difference of two or more recognition candidates' face 
calculated by the above-mentioned characteristic quantity extract means, The similarity of the 
characteristic quantity of a recognition candidate's face obtained by the above-mentioned 
characteristic quantity extract means and the characteristic quantity beforehand registered into the 
above-mentioned registration information maintenance means is calculated. Face image recognition 
equipment characterized by providing a person recognition means to recognize a recognition 
candidate, and the control means which controls whether predetermined actuation is permitted 
based on the recognition result of the above-mentioned person recognition means. 
[Claim 3] It is face image-recognition equipment according to claim 2 which the information 
concerning the specific person who permits predetermined actuation is beforehand held at the 
above-mentioned registration information maintenance means, and carries out as the description in 
what the above-mentioned control means controls to permit predetermined actuation when it is 
judged as a result of recognition of the above-mentioned person recognition means that the specific 
person concerned is contained at least in the above-mentioned recognition candidate. 
[Claim 4] The criteria for presuming each age group and the becoming criteria characteristic 
quantity are held beforehand at the above-mentioned registration information maintenance means. 
The above-mentioned control means The characteristic quantity extracted by the above-mentioned 
characteristic quantity extract means and the criteria characteristic quantity beforehand stored in 
the above-mentioned registration information maintenance means are measured. Face image 
recognition equipment according to claim 2 characterized by what is controlled to permit 
predetermined actuation when it is judged that the person beyond predetermined age is contained at 
least in the above-mentioned recognition candidate. 

[Claim 5] A direction judging means of a face to judge the direction which a recognition candidate's 
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face has turned to based on the information concerning the face field extracted by the above- 
mentioned face field extract means, Provide further the guidance output means which carries out 
the guidance output of the recognition result of the above-mentioned person recognition means, and 
the predetermined directions at least, and it sets at the time of a recognition candidate's face image 
registration. Checking whether a recognition candidate's face is suitable as the above-mentioned 
guidance with the above-mentioned direction judging means of a face by carrying out a guidance 
output so that a face may be turned in two or more directions with the above-mentioned guidance 
output means at a recognition candidate Calculate the characteristic quantity for every direction 
with the above-mentioned characteristic quantity extract means, and the characteristic quantity 
concerned and the information concerning the detection precision of the direction of a face by the 
above-mentioned direction judging means of a face are stored in the above-mentioned registration 
information maintenance means. Face image recognition equipment according to claim 2 
characterized by what is done for a guidance output through the above-mentioned guidance output 
means based on the information concerning the detection precision stored in the above-mentioned 
registration information maintenance means at the time of a recognition candidate's authentication 
so that a recognition candidate's direction of a face may turn to the direction where detection 
precision is high. 

[Claim 6] In the face image recognition approach of recognizing a recognition candidate's face image 
and judging the propriety of actuation of a controlled object based on the recognition result 
concerned The face image recognition approach characterized by what the above-mentioned 
recognition candidate's face image is extracted, the characteristic quantity which shows the 
individual difference of the face image concerned is calculated, the characteristic quantity 
concerned and the characteristic quantity held beforehand are measured, the above-mentioned 
recognition candidate is specified, and the propriety of actuation of a controlled object is judged for 
based on the specific result concerned. 

[Claim 7] The step which inputs a recognition candidate's image, and the step which extracts a 
recognition candidate's face field in the above-mentioned image, The step which calculates the 
characteristic quantity which shows the individual difference of a recognition candidate's face based 
on the information concerning the above-mentioned face field, The step which stores beforehand 
the characteristic quantity which shows the individual difference of two or more recognition 
candidates' face, the characteristic quantity of the above-mentioned recognition candidate's face, 
and the account of a top — the face image recognition approach characterized by calculating 
similarity with the characteristic quantity registered beforehand, and providing the step which 
recognizes a recognition candidate, and the step which controls whether predetermined actuation is 
permitted based on the above-mentioned recognition result. 

[Claim 8] The face image recognition approach according to claim 7 characterized by having further 
the step which holds beforehand the information concerning the manager who permits 
predetermined actuation, and the step controlled to permit predetermined actuation when it is 
judged that the manager concerned is contained at least in the above-mentioned recognition 
candidate. 

[Claim 9] The face image-recognition approach according to claim 7 characterized by to measure 
the criteria for presuming each age group, the step which holds the becoming criteria characteristic 
quantity beforehand, and. the extracted characteristic quantity and the criteria characteristic 
quantity stored beforehand, and to have further the step controlled to permit predetermined 
actuation when it is judged that the person beyond predetermined age is contained at least in the 
above-mentioned recognition candidate. 

[Claim 10] Checking whether a recognition candidate's face is suitable as the above-mentioned 
guidance by carrying out a guidance output so that a face may be turned in two or more directions 
at a recognition candidate at the time of registration In the step which calculates the characteristic 
quantity for every direction and stores the characteristic quantity concerned and the information 
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concerning the detection precision of the direction of a face, and the time of authentication The 
face image recognition approach according to claim 7 characterized by having further the step which 
carries out a guidance output so that a recognition candidate's direction of a face may turn to the 
direction where detection precision is high based on the information concerning the above- 
mentioned detection precision. 



[Translation done.] 
* NOTICES * 

JPO and NCI PI are not responsible for any 
damages caused by the use of this translation. 

LThis document has been translated by computer. So the translation may not reflect the original 
precisely. 

2.**** shows the word which can not be translated. 
3.1n the drawings, any words are not translated. 



DETAILED DESCRIPTION 



[Detailed Description of the Invention] 
[0001] 

[Field of the Invention] This invention extracts a face image from an input image, and relates to the 
face image recognition equipment and the face image recognition approach of performing 
predetermined registration and authentication based on the face image concerned. 
[0002] 

[Description of the Prior Art] Various techniques are developed today under recognition that a face 
image recognition technique is useful to construction of a security system or a human interface. 
[0003] Generally, the personal authentication equipment which attests an individual with a face 
image is controlling the device based on the result of having measured the **** minute amount 
corresponding to an ID card, a personal identification number, etc., and the **** minute amount of 
one person who is in front of a camera. And in the dictionary registration for personal authentication 
by the face, a face image is restarted several times, and in that case, if several images with a 
certain amount of variation gather without specifying especially a motion, it is considering as 
registration termination. Moreover, that the injustice by so-called "spoofing" at the time of 
photography should be prevented, I had you wink at the time of photography, and the technique 
which checks a motion of a face also existed. 

[0004] Hereafter, concrete precedence reference is mentioned and the conventional technique is 
explained. 

[0005] for example, him who makes a setting change at the image acquisition conditions of having 
been suitable for the re-discernment processing concerned, and identifies a specific person 
certainly in JP,1 1-316836.A (the precedence reference 1 is called hereafter) when carrying out re- 
discernment processing with his specification — the technique about specific equipment is 
indicated. That is, especially with this technique, when that he is him cannot recognize at the time 
of authentication, lighting conditions are changed or it is characterized by making people's sense 
changed. 

[0006] On the other hand, in JP,10-232934,A (the precedence reference 2 is called hereafter), the 
technique about the face image registration equipment which registers a face image, and its 
approach is indicated, checking actuation for recognition. That is, with this technique, actuation 
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which does not have the relation to face authentication whether the authentication candidate is 
operating another device, in the case of registration of a face image in any way is checked. 
[0007] Furthermore, in the patent number No. 2915013 official report (the precedence reference 3 is 
called hereafter), the technique about the image recognition equipment which specifies each 
member who views and listens in a supervised area is indicated. That is, with this technique, both 
hiding luminaire and video sensor are used, and a predetermined individual is identified out of the 
recognition candidate slack viewer in a monitor field. 
[0008] 

[Problem(s) to be Solved by the Invention] However, the following problems existed in the above- 
mentioned conventional technique. 

[0009] namely, — personal authentication equipment according to the face under development in 
recent years although various security is installed to what has high significance, such as the 
dangerous substance and a strictly confidential housing, — a photograph — being the so-called — 
" — becoming completely — " — detection of a malicious person was difficult for substitution of a 
video image etc. Moreover, after authentication of a face image was completed, there is no way 
which controls a malfeasance and the problem of the face authentication system itself existed. 
Moreover, face authentication etc. was not used, but when a specific manager complemented a key 
and it was hopeful, another problem that lost a key or it was stolen also by the approach etc. was 
also produced. 

[0010] Moreover, if it is not beyond predetermined age, and only the technique of restricting dealing 
by time amount will exist but the technical field concerning the automatic vending machine with 
which to be unable to sell and buy is desired will also avoid even the public notice, the present 
condition will be being able to sell and buy with regards to age there being nothing. Although parents' 
consent document and companion were required at the store when those who do not fill the age 
concerned with the object which cannot be dealt in unless it is beyond predetermined age 
purchased, it was difficult to automate fully. 

[001 1] Furthermore, although the technique amended using the face image obtained to dispersion in 
the sense of a face at the time of authentication was taken when registered by the face image 
information of about several sheets, it was difficult to amend completely. Moreover, in order to have 
collected the sense of the face which has a variation, without using extra hardware at the time of 
dictionary registration, issuing guidance of "moving face"-simply extent was only completed, and 
equalization corresponding to the above-mentioned guidance of how to move a registrant's face was 
not able to be attained. 

[0012] moreover, the time of photography — being the so-called — " — becoming completely — " 
— although there is also a technique about the face image authentication equipment made to wink 
at the time of photography in order to prevent, if actuation of there being a limit in the judgment 
precision of a blink, for example, making the part of the eye of a photograph distorted by hand etc. is 
carried out — " — becoming completely — " — ** — possibility said that the said malfeasance was 
materialized was left behind. Moreover, for some persons, the problem that the detection precision 
of a face was low etc. existed. 

[0013] By the above-mentioned precedence reference 1 besides above, the information of the 
sense which is easy to recognize beforehand at the time of registration, or the sense which is hard 
to recognize was acquired, and, as for saying [ issuing directions according to the information 
concerned ], even suggestion was not carried out at all. With the technique concerning the above- 
mentioned precedence reference 2, it was not checking about whether the face image for face 
authentications itself is good, the above-mentioned precedence reference 3 — the purpose of 
recognition — existence of a viewer — it is — it did not pass and was not suggested at all about 
the judgment of authorization/disapproval of actuation of a device. 

[0014] This invention prevents the malfeasance at the time of authentication, and the place which it 
was made in view of the above-mentioned problem, and is made into the purpose has it in offering 
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the face image recognition equipment and the face image recognition approach of realizing highly 

precise face image recognition. 

[0015] 

[Means for Solving the Problem] In the face image recognition equipment which recognizes a 
recognition candidate's face image and judges the propriety of actuation of a controlled object in 
this invention based on the recognition result concerned in order to attain the above-mentioned 
purpose Extract the above-mentioned recognition candidate's face image, and the characteristic 
quantity which shows the individual difference of the face image concerned is calculated. The 
characteristic quantity concerned and the characteristic quantity held beforehand are measured, the 
above-mentioned recognition candidate is specified, and the face image recognition equipment 
characterized by providing ** for the control means which judges the propriety of actuation of a 
controlled object based on the specific result concerned is offered. 

[0016] Furthermore, an image input means to input a recognition candidate's image in this invention, 
A face field extract means to extract a recognition candidate's face field in the image obtained 
through the above-mentioned image input means, A characteristic quantity extract means to 
calculate the characteristic quantity which shows the individual difference of a recognition 
candidate's face based on the information concerning the face field extracted by the above- 
mentioned face field extract means, A registration information maintenance means to store 
beforehand the characteristic quantity which shows the individual difference of two or more 
recognition candidates' face calculated by the above-mentioned characteristic quantity extract 
means, The similarity of the characteristic quantity of a recognition candidate's face obtained by the 
above-mentioned characteristic quantity extract means and the characteristic quantity beforehand 
registered into the above-mentioned registration information maintenance means is calculated. The 
face image recognition equipment characterized by providing a person recognition means to 
recognize a recognition candidate, and the control means which controls whether predetermined 
actuation is permitted based on the recognition result of the above-mentioned person recognition 
means is offered. 

[0017] Moreover, in this invention, recognize a recognition candidate's face image and it sets to the 
face image recognition approach of judging the propriety of actuation of a controlled object based 
on the recognition result concerned. The above-mentioned recognition candidate's face image is 
extracted, the characteristic quantity which shows the individual difference of the face image 
concerned is calculated, the characteristic quantity concerned and the characteristic quantity held 
beforehand are measured, the above-mentioned recognition candidate is specified, and the face 
image recognition approach characterized by what the propriety of actuation of a controlled object 
is judged for based on the specific result concerned is offered. 

[0018] Furthermore, the step which inputs a recognition candidate's image in this invention and the 
step which extracts a recognition candidate's face field in the above-mentioned image, The step 
which calculates the characteristic quantity which shows the individual difference of a recognition 
candidate's face based on the information concerning the above-mentioned face field, The step 
which stores beforehand the characteristic quantity which shows the individual difference of two or 
more recognition candidates' face, the characteristic quantity of the above-mentioned recognition 
candidate's face, and the account of a top — similarity with the characteristic quantity registered 
beforehand is calculated, and the face image recognition approach characterized by providing the 
step which recognizes a recognition candidate, and the step which controls whether predetermined 
actuation is permitted based on the above-mentioned recognition result is offered. 
[0019] 

[Embodiment of the Invention] Hereafter, the gestalt of operation of this invention is explained with 
reference to a drawing. 

[0020] Here, the gestalt of various operations of the face image recognition equipment and the 
approach of recognizing the face of one person or two or more persons contained in the input image 
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it might be picturized with the camera is explained. 

[0021] That is, the gestalt of the 1st operation explains the configuration and operation of face 
image recognition equipment common to the gestalt of all operations. And it explains focusing on 
registration and authentication of the face which makes the direction and certification of a face 
change, and with the gestalt of the 2nd operation, the gestalt of the 3rd operation explains focusing 
on control concerning recognition of two or more faces, and it explains focusing on control 
concerning age presumption with the gestalt of the 4th operation by it on the assumption that this. 
[0022] First, the gestalt of operation of the 1st of this invention is explained. 
[0023] Drawing 1 is the block diagram of the example of application of the face image recognition 
equipment concerning the gestalt of the 1st operation. 

[0024] Drawing 1 (a) applies face image recognition equipment to control of closing motion of a door 
like the door metallurgy warehouse of a path (a door control mold is called hereafter), and drawing 1 
(b) applies face image recognition equipment to an automatic vending machine (an automatic- 
vending-machine mold is called hereafter). 

[0025] As shown in drawing 1 (a), in the door control mold, the monitor 1 for guidance is arranged in 
the upper part, and three CCD cameras 2 are arranged at the lower part. Furthermore, the control 
section 3 and the personal computer (or workstation) 4 which manages the whole control are 
arranged. On the other hand, as shown in drawing 1 (b), similarly, the monitor 1 for guidance is 
arranged in the upper part, and three CCD cameras 2 are arranged for the automatic-vending- 
machine mold at the lower part. Furthermore, the control section 3 and the personal computer (or 
workstation) 4 which manages the whole control are arranged. 

[0026] Thus, in the example of application of the gestalt of the 1st operation, predetermined control 
based on the result of the personal authentication by the face will be performed in the above- 
mentioned control section 3 according to various applications which are mentioned later for details. 
[0027] Drawing 2 is the block diagram showing the configuration of the face image recognition 
equipment concerning the gestalt of the 1st operation. As shown in this drawing 2 , the output of 
the image input section 11 which has a camera etc. is connected to the input of the face field 
detecting element 12, and the output of this face field detecting element 12 is connected to the 
input of the direction judging section 13 of a face. The output of the above-mentioned direction 
judging section 1 3 of a face is connected to the input of the face part extract section 14, and the 
output of this face part extract section 14 is connected to the input of the person recognition 
section 15. Furthermore, this person recognition section 15 is connected to the registration 
information attaching part 16, the appliance control section 18, and mutual free [ a communication 
link ]. Each output of each part 12 of the above besides above or 15 is connected to the input of 
the guidance output section 1 7. 

[0028] It is as follows when an operation of the face image recognition equipment of such a 
configuration is outlined. 

[0029] That is, the above-mentioned image input section 1 1 stores in memory the digital image data 
inputted from one or more cameras. Furthermore, the face field detecting element 12 detects the 
face field of all the members' persons who exist in an image to each image. It can come, 
simultaneously the direction judging section 13 of a face judges the direction which each face has 
turned to. 

[0030] In each face field, the above-mentioned face part extract section 14 detects face parts, 
such as eye nasal meatus, and performs the inclination and the normalization of size of a face based 
on those physical relationship. And the above-mentioned person recognition section 15 calculates 
the characteristic quantity and similarity of a face of each people which are beforehand registered 
into the registration information attaching part 6 using the result of having accumulated the 
obtained normalization face image by time series, and identifies who the everybody object which 
exists in an image is. 

[0031] It is outputted to the guidance output section 7, and also when desired actuation is 
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permitted by the person recognition section 15, control of the target device is performed in the 
appliance control section 18 by the result obtained by the above processing, moreover, the case 
where it is the sense of the face which the direction judging section 13 of a face judges the sense 
of the face of an everybody object at the time of authentication of a face, and is hard to recognize 
at the time of registration and a photograph — being the so-called — " — becoming completely — 
" — when there is no motion of a face like, guidance of making the direction of a face changed in 
the guidance output section 17 is outputted. 

[0032] Hereafter, each part 11 of the above thru/or processing by 18 are embodied, and it explains 
to a detail. 

[0033] After the above-mentioned image input section 1 1 picturizes a face image with a CCD 
camera etc. and performs A/D conversion, it records the above-mentioned face image as digital 
data in the memory in the body of equipment. In addition, one will be sufficient as the number of the 
above-mentioned CCD cameras, it may have more than one, and each part 12 which is mentioned 
later thru/or processing by 18 will be repeated to the image in the memory incorporated by two or 
more CCD cameras, respectively. 

[0034] The above-mentioned face field detecting element 12 makes a face field the location which 
acquired the highest correlation value by calculating a correlation value, moving within an image the 
template of the average face beforehand prepared out of the image. Moreover, in corresponding to 
plurality, it asks for the apex (local peak) in a partial field, and when the correlation value exceeds a 
predetermined threshold, it adds as a face field. In addition, the face extraction method using not a 
correlation value but a proper space method and a subspace method etc. is also applicable. 
[0035] In the above-mentioned direction judging section 13 of a face, the template doubled in the 
direction of faces, such as four-directions slant beforehand made from many persons' face image, is 
prepared to all the face fields extracted in the above-mentioned face field detecting element 12, and 
it presumes which direction is turned to. Moreover, it is also possible to adopt the approach of 
detecting the location of the components of a face which is stated by JP.9-1471 19,A. 
[0036] In the above-mentioned face part extract section 14, face components, such as an eye, a 
nose, and opening, are detected from the inside of each obtained face field, the detection approach 
of this face component — reference (Kazuhiro Fukui and the Yamaguchi ** — it is realizable by 
using a degree-of-separation filter so that it may be explained by /'face focus extract by 
combination of configuration extract and pattern title" Institute of Electronics, Information and 
Communication Engineers paper (magazine D) vol.J80 and D— II, No.8, and pp 2177..2177 (1997).) 
[0037] Next, based on the location of the components of the detected face, a face field is started in 
fixed magnitude and a configuration, an inclination and magnitude are amended, and the field of a 
mxn pixel is created. Hereafter, the information on this mxn dimension is used as a face feature 
vector. 

[0038] Here, when making it the sense of a face different from current that it is hard to detect the 
components of faces, such as the eyes and the nose, and it is said that they do not have fluctuation 
like a photograph although the case where the information on being easy to detect a face etc. is 
beforehand held in the dictionary, and detection have been performed, guidance "turn to a 
predetermined direction" from the below-mentioned guidance output section 17 is outputted. 
[0039] Then, the next processing is performed in the person recognition section 15. 
[0040] Here, drawing 3 is drawing showing an example of the characteristic quantity information on a 
face. 

[0041] The left figure of drawing 3 shows the data which collected the face field image which might 
be processed by the face field detecting element 12 in the input image by time series, when the 
right figure of drawing 3 asks for the orthonormal vectors by the K-L expansion from time series 
image data, calculates subspace, and images and displays the characteristic vector. 
[0042] This subspace is used as a description of the discernment dictionary for identifying a person, 
and the face in an input image. What is necessary is just to use for recognition the subspace of the 
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dictionary registered beforehand, and the subspace created from the input image. 
[0043] with the gestalt of this operation, reference (Ken-ichi Maeda and Sadakazu Watanabe — 
/'method of superposition which introduced local structure" Institute of Electronics, Information and 
Communication Engineers paper (magazine D) vol.J68-D, No.3, and pp 345-352 (1985)), and the 
mutual subspace method indicated by JP.9-251 534.A are adopted as the recognition approach. 
[0044] By the above flow, it will identify who the person photoed with the camera is by measuring 
the dictionary data and characteristic quantity for every each people, or it will be identified whether 
you are an applicable person. What is necessary is here, just to let the person corresponding to the 
data which take the maximum similarity be a discernment result that what is necessary is just to ask 
for whether it is most similar to which person's dictionary, in order to identify a person. Moreover, in 
performing authentication by the face using a card, a registration number, a personal identification 
number, a key, etc., similarity with the recognition data corresponding to individual humanity news, 
such as a card of an everybody object and a number, is calculated, and it sets up a threshold 
beforehand, and an applicable person will be identified when the above-mentioned similarity exceeds 
this threshold. 

[0045] The above-mentioned registration information attaching part 16 holds to coincidence 
information, such as characteristic quantity (this example subspace or a matrix of correlation etc.) 
of the face used in order to identify a person, and "sense of the face which is easy to recognize" 
and "sense of the face which is hard to recognize" which were recorded at the time of registration 
of a face. Moreover, status information, such as the time of day in the case of registration, time, a 
location, a person's sex, age, height, and an ID number, etc. can be accumulated in coincidence. The 
image data of the inputted face itself is sufficient. 

[0046] Moreover, it is also possible to prepare more than one to one person, for example, when 
fluctuation takes place remarkably like [ when glasses are covered / at the time of removing 
glasses ], two recognition data are prepared, and suppose that it has collated when one of data has 
been identified. In addition, it is not restricted to glasses but, in the case of a woman, can use for 
the existence of makeup etc. 

[0047] The above-mentioned appliance control section 18 sends the signal of actuation 
authorization to a controlled-system device, when it is that from which the person has got 
authorization of predetermined actuation beforehand when it was a specific person in the person 
recognition section 15 and is identified. For example, in the door control mold which is the example 
of application mentioned above, if drive control can be carried out or it enables it to take a specific 
object in and out so that the lock of a door may be canceled and a door can be opened, things will 
be mentioned. 

[0048] Moreover, in performing authentication for obtaining authorization of the actuation to a 
certain specification ID using a card, a registration number, a personal identification number, a key, 
etc., the actuation will be permitted when similarity with the recognition data corresponding to 
individual humanity news, such as each person's card and a number, exceeds a predetermined 
threshold. 

[0049] Next, the gestalt of operation of the 2nd of this invention is explained. 

[0050] the face image recognition equipment concerning the gestalt of the 2nd operation — the 1st 
function of the gestalt of operation — in addition — while specifying the direction of a face — 
registration of a face image — carrying out — and detection of the eyes and the nose — being hard 
— the description is in the point of having the function to register into a dictionary the sense of a 
face, and the sense of a face which is easy to detect. 

[0051] In addition, the example of application of the gestalt of this 2nd operation is the same as that 
of drawing 1 explained previously, and is the same as that of drawing 2 explained in the gestalt of 
the 1st operation also about the basic configuration. So, face image registration processing is 
explained to a detail by the following explanation, checking the direction of a face, referring to 
drawing 1 and drawing 2 suitably. 
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[0052] Hereafter, with reference to the flow chart of drawing 5 , registration processing of the face 
image by the face image recognition equipment concerning the gestalt of the 2nd operation is 
explained in full detail. 

[0053] In addition, the following threshold shall have the relation of 0<ThKTh2. 
[0054] When it is going to register a face image newly, the manager of a system starts the system 
for registration. A registration candidate stands before the image input section 1 1 and the guidance 
output section 1 7, and changes the sense of a face as the directions from the guidance output 
section 17. 

[0055] At this time, a guidance output screen as shown in drawing 4 is displayed. 
[0056] The interior 21 of the direction assignment proposal of a face which directs the sense of a 
face according to the image picturized with the camera 22 by the monitor 1 for guidance as shown 
in this drawing 4 , and the timetable beforehand determined as the face detection result display 20 
which outputs whether a person's face was detectable is displayed, and assignment of a direction 
that a face should be turned to the timetable defined beforehand is changed at any time. This 
timetable is beforehand created so that the face image of various directions, such as four-directions 
slant, may be obtained (step S1). 

[0057] Then, incorporation of a face image with a camera 22 is made (step S2), and the judgment of 
the direction of a face is performed (step S2). And it is judged whether the direction shown in the 
guidance output section 17 was turned to, and the image pick-up was performed (step S4). Here, 
when the direction which shifted to step S5 and was shown when the shown direction was turned to 
and an image pick-up was performed is turned to and an image pick-up is not performed, it shifts to 
step S8. 

[0058] At step S5, the face image of the predetermined direction can detect by the with a 
predetermined threshold [ Th ] of less than one time amount Count, and it is judged whether it is 
****. And when detection is completed in the with a predetermined in the face image of the 
predetermined direction threshold [ Th ] of less than one time amount Count, after judging with it 
being the direction of the face which (step S5) and its direction tend to detect and registering with 
the dictionary of a face as "a direction which is easy to detect a face", it shifts to step S7 (step 
S6). On the other hand, when the face image of the predetermined direction is not able to detect by 
the with a predetermined threshold [ Th ] of less than one time amount Count, it shifts to step S7, 
without performing registration (step S5). 

[0059] On the other hand, at step S8, it is judged whether there was any direction which cannot 
detect a face image even if it goes through the with a predetermined thresholds [ Th ] of two or 
more time amount Count. And even if it goes through the with a predetermined thresholds [ Th ] of 
two or more time amount Count, when there is a direction which cannot detect a face image, after 
registering with a dictionary conversely as "a direction which cannot detect a face easily", it shifts 
to step S7 (step S9). On the other hand, even if it goes through the with a predetermined thresholds 
[ Th ] of two or more time amount Count, when there is no direction which cannot detect a face 
image, after incrementing the above-mentioned time amount Count, it returns to the above- 
mentioned step S2 (step S10). 

[0060] in this way — a timetable — termination — propriety — judging — a timetable (step S7) — 
termination — becoming — if — all — registration — ending — ending — **** — if — a degree — 
a timetable — doubling — guidance — an output — the section — 17 — from — a face — a 
direction — specifying — while — time amount — Count — zero — initializing (step S1 1) — the 
above — a step — S — two — return — the above — being the same — actuation — repeating - 

[0061] Thus, the information on the sense of the registered face is used at the time of 
authentication. 

[0062] Namely, when using together with an ID card or a personal identification number, it sets. 
When an authentication candidate's dictionary is specified The "direction of the face which is easy 
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to detect " registered into the dictionary concerned is used. If the direction registered as the time of 
an authentication candidate's face being temporarily undetectable or "a direction which is hard to 
detect" is turned to, when it will have been recognized in the direction judging section 13 of a face, 
it directs to turn to "the direction which is easy to detect" in the guidance output section 17. 
[0063] moreover, it is based on a photograph by suggesting that the predetermined direction is 
turned to from the guidance output section 1 7, also when the direction of a face does not change 
beyond predetermined time — being the so-called — " — becoming completely — " — ** — it 
becomes possible to carry out before-it-happens prevention of the said injustice. 
[0064] Next, the gestalt of operation of the 3rd of this invention is explained. 
[0065] When [ which was mentioned above ] dealing with the dangerous substance and valuables, 
while being accompanied by company of the person who belongs to a specific manager group in 
addition to the 1st function of the gestalt of operation, the face image recognition equipment 
concerning the gestalt of the 3rd operation has the description in the point of having the function to 
permit predetermined actuation, only when two or more persons' face has been recognized. 
[0066] In addition, the example of application of the gestalt of this 3rd operation is the same as that 
of drawing 1 explained previously, and is the same as that of drawin g 2 except the point mentioned 
later of having also explained the basic configuration in the gestalt of the 1st operation. So, face 
image authentication processing is explained to a detail by the following explanation, checking the 
direction of a face, referring to drawing 1 and drawing 2 suitably. 

[0067] With the gestalt of this 3rd operation, modification is added to the person recognition section 
15 of drawing 2 , and appliance control section 18 ******. That is, only when the face of a multiple 
name including the person who belongs to a manager group has been recognized, or only when the 
existence more than the number of Sadato Tokoro has been recognized, control which gives 
authorization of predetermined actuation is made. 

[0068] Furthermore, in the image input section 1 1, a wide angle camera may be used so that two or 
more persons can take a photograph to coincidence, two or more cameras may be installed, and you 
may process to coincidence. 

[0069] Moreover, for the reason in case the registration information attaching part 16 carries out 
actuation in which each people need company of a manager in addition to all registration persons' 
information, information — whether it belongs to the manager group — is also held beforehand. 
[0070] Hereafter, with reference to the flow chart of drawing 6 , the authentication processing by 
the face image recognition equipment concerning the gestalt of the 3rd operation is explained in full 
detail. 

[0071] Initiation of recognition processing recognizes the everybody object in the input image 
obtained in the image input section 1 1 (step S21). Here, the face image of all the persons that exist 
in an input image is extracted, and the person equivalent to each face image is specified as the 
registration attaching part 16 based on the information currently held beforehand. Then, it is judged 
whether you are those for whom those who are going to operate it need company of a manager 
(step S22). 

[0072] In this step S22, when it is judged that they are those who need company of a manager, the 
person of a multiple name exists in an input image, a manager exists in the actuation which needs 
existence of a manager, or (step S24) and a multiple name, or (step S25) it is judged. Hereafter, this 
is explained in full detail. 

[0073] Actuation is refused when it is judged that the person of a multiple name does not exist in an 
input image at the above-mentioned step S23 (step S29). 

[0074] [ when it is judged that the person of a multiple name exists in an input image in the above- 
mentioned step S23 ], when it is judged in step S24 that existence of a manager is not required 
actuation, it is judged whether the number beyond a predetermined threshold exists (step S27). In 
this step S27, when it is judged that the number beyond a predetermined threshold does not exist, 
actuation is refused (step S29), and when judged as existence, actuation is permitted (step S28). 
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[0075] Actuation is permitted when it is judged that actuation is refused (step S29) and it exists 
when it is judged that a manager does not exist in a multiple name at step S25 when existence of a 
manager is judged to be required actuation at the above-mentioned step S24 (step S28). 
[0076] Thus, the "1st mode" in which at least one person will permit actuation if it is the person 
who is unnecessary as for existence of a companion and is beforehand registered with the gestalt of 
the 3rd operation, The "2nd mode" which permits actuation only when more than the predetermined 
number exists in coincidence, although combination will not be asked, if it is the registered person, 
Only while some persons beforehand registered as a manager are going together, 
authorization/disapproval is judged according to the "3rd mode" which permits actuation. The 
above-mentioned mode can be freely changed with application. 
[0077] Next, the gestalt of operation of the 4th of this invention is explained. 
[0078] The face image-recognition equipment concerning the gestalt of the 4th operation has the 
description in the point of having the function judge authorization of actuation automatically, by 
checking whether there is any company of the person beyond predetermined age, when the person 
below predetermined age tries to operate it by the thing which were mentioned above and for which 
a person's age is presumed in addition to the 1st function of the gestalt of operation. 
[0079] In addition, the example of application of the gestalt of this 3rd operation is the same as that 
of drawing 1 explained previously, and is the same as that of drawing 2 except the point mentioned 
later of having also explained the basic configuration in the gestalt of the 1st operation. So, age 
presumption processing is explained to a detail by the following explanation, referring to drawing 1 
and drawing 2 suitably. 

[0080] With the face image recognition equipment concerning the gestalt of this 4th operation, in 
order for what is necessary to be not to specify a person and to be able to presume only age, as 
shown in drawing 7 , the direction judging section 13 of a face and the person recognition section 15 
of drawing 2 are permuted by the characteristic quantity extract section 23 and the age 
presumption section 24. In addition, the image input section 1 1 may use the wide angle camera 
which a multiple name can photo to coincidence, may install two or more cameras, and may process 
to coincidence. 

[0081] Moreover, in the registration information attaching part 16, the dictionary which holds the 
characteristic vector which shows the description of each age group obtained by carrying out the 
K-L expansion of the average face image according to [ various ] age group or many face images of 
the same age group, and holds the individual description like [ to the gestalt of the above-mentioned 
operation ] is unnecessary. It is realizable with a means by which the age information to an individual 
can be correctly outputted by putting in an individual specific dictionary. 

[0082] Hereafter, with reference to the flow chart of drawing 8 , the age presumption processing by 
the face image recognition equipment concerning the gestalt of the 4th operation is explained. 
[0083] Initiation of processing extracts the face image of all the persons that exist in the input 
image obtained in the above-mentioned image input section 11. And the age presumption section 22 
presumes the person's age by the age group judged as similarity being the highest, referring to the 
age information held beforehand at the registration information attaching part 16 to each face image 
(step S31). 

[0084] Subsequently, it is judged whether the companion beyond predetermined age needs the 
object which it is going to operate (step S32). 

[0085] And when the companion beyond predetermined age is not required, actuation is permitted 
(step S35), and when the companion beyond predetermined age is required, it is judged whether the 
person beyond predetermined age exists in two or more person object (step S33). 
[0086] And actuation is refused, if the person beyond predetermined age exists, and actuation is 
permitted (step S35) and it does not exist (step S34). 

[0087] Thus, with the gestalt of the 4th operation, only when judged with the companion beyond 
predetermined age being unnecessary and there being a person beyond predetermined age in the 1st 
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mode in which anyone permits actuation, one person, or two or more persons, authorization/refusal 
of actuation are judged according to the 2nd mode which permits actuation. The above-mentioned 
mode can be suitably changed with application. 

[0088] According to this invention explained above, the following effectiveness is done so. 
[0089] (1) Two or more face authentications can be performed to coincidence with the person of 
company who fulfills predetermined conditions, such as a manager, a companion, etc. who were 
beforehand registered with the face authentication candidate who wants to operate a request on the 
effect fruits occasion in two or more face authentication with a manager, and predetermined 
actuation can be permitted with the combination of an authentication result. Therefore, a manager 
does not need to walk around with media, such as a key, what is necessary is to come to attest by 
a manager going together, only when required, and also since there is a monitor by the manager also 
after finishing automatic authentication, it becomes possible to impose a fixed limit on actuation. 
[0090] (2) If there is not a companion beyond predetermined age even when the person below 
predetermined age appears by presuming the age of the person who is going to do effectiveness 
actuation in age presumption, it can avoid permitting actuation. 

[0091] (3) By directing the sense of a face, performing the direction judging of a face of whether to 
have turned to the direction correctly at the time of registration of the face image in the 
effectiveness face authentication equipment in face registration, or there is no the face 

images which turned to many directions are collected, and a face image can be registered with a 
sufficient precision. Moreover, if there is the direction of the face which cannot extract the part of a 
face or a face well at the time of registration, it will record on the dictionary and coincidence which 
show the individual description. 

[0092] (4) it is based on a photograph by changing the direction which I have turn to the 
predetermined direction at the time of the effectiveness authentication in face authentication, and 
is made to turn to at every authentication, or making the direction of plurality turn to — being the 
so-called — " — becoming completely — " — prevent and also accurate face authentication can 
carry out by having the direction out of which the description of the face saved at coincidence at 
the time of registration of a face tends to come, and the direction out of which it is hard coming for 
each individual. 
[0093] 

[Effect of the Invention] According to this invention, the malfeasance at the time of authentication 
can be prevented and the face image recognition equipment and the face image recognition 
approach of realizing highly precise face image recognition can be offered. 
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[Drawing 1] (a) is drawing showing the configuration at the time of applying the face image 
recognition equipment concerning the gestalt of the 1st operation to control of closing motion of a 
door like the door metallurgy warehouse of a path, and (b) is drawing showing the configuration at 
the time of applying the face image recognition equipment concerning the gestalt of the 1st 
operation in an automatic vending machine. 

[Drawing 2] It is the block diagram showing the configuration of the face image recognition 
equipment concerning the gestalt of the 1st operation. 

[ Drawing 3] It is drawing showing an example of the characteristic quantity information on the face 
extracted with the face image recognition equipment concerning the gestalt of the 1st operation. 
[Drawing 4] It is drawing showing an example of the guidance output screen by the face image 
recognition equipment concerning the gestalt of the 2nd operation. 

[Drawing 5] It is a flow chart for explaining registration processing of the face image by the face 
image recognition equipment concerning the gestalt of the 2nd operation in full detail. 
[Drawing 6] It is a flow chart for explaining the authentication processing by the face image 
recognition equipment concerning the gestalt of the 3rd operation in full detail. 
[ Drawing 7] It is the block diagram showing the configuration of the face image recognition 
equipment concerning the gestalt of the 4th operation. 

[Drawing 8] It is a flow chart for explaining the age presumption processing by the face image 
recognition equipment concerning the gestalt of the 4th operation. 
[Description of Notations] 

1 Monitor for Guidance 

2 Camera 

3 Control Section 

4 Personal Computer 

1 1 Image Input Section 

12 Face Field Detecting Element 

13 The Direction Judging Section of Face 

14 Face Part Extract Section 

15 Person Recognition Section 

1 6 Registration Information Attaching Part 

17 Guidance Output Section 

18 Appliance Control Section 
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l=*«>*(=l*. *«(= rB£MfrLT<*:£lVl 

EBftl=**B tfciS-' lbl*0*iT l*ft*V3fc. 
[ooi2] vkbimiobii rj«yr*Lj * 

»B!=B-*-*ft«t..fc«*<. B$(t>«ISBJS(=liBBA< 
fey. •Mx[«m©IB<D»»*^-Cg*1±*l¥i: ixo 

[0 0 13] ±IE5fefTS:il5 1 1?(±> ^ttg 

«^I=BB t LMr] ^ ^>BSJ L BixB £ £ tx 3 fflB « B 
a^m«(=^t>-ti-C»**tt-rtL>ofcCi:l*<iiI 
P.^i*-^e>*^TtxftAxofc. JifB5feff*®t2l=*xAx«) 
BB-CI*.. BSBEU0l+fl>BB«!gtt:A<g:»Ax5Ax|=-DLx 
Tlifit»» LTtxftAxofc. ±IEifeffS:^3T?l*. B 

[0 0 14] J:fHBg®«cg^Tft$4xfct© 

^RfijtL. iS^a)BB&BB$il^T-&BB^B!tS 
B*^BB«B»*a*ffi«t1-*ci(=fe*. 

[0 0 15] 

l=. BB»BBO>BBB$BBL. 
B^SI=S-5lxT«ffllffllfe(DIiiff<DWS**ilS-r-SBB 
«BBBfil=fctx-C. ±8BBB^#a>BB^$tttU 

l, a»BB«wDBAB**r«aasw»L. 
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[0 0 16] Bi&*t&#©lH££ 

««i=«*ni«i=»--3i*T. Sii**Si#«>Si<&BAM£ 

[OO 1 71 £f=. BSStt&#a>iaH»£ 
SHI L. SKSKemi=S-^ ^-ca»lffliftl<D8!)^<DRrS 

sl. safest ?A«»sftfcftiasi:£it8u 

[OO 1 8] £*.(::. SSI**&#0>IS«£ 

s^f'^t. &»<Dgi8**st#©ti<Dfi as 

lt. gftwtf^ssrrsxT ±beb«* 

[0 0 1 9] 

[S6W©H«5<0»®] KIT. Ea£#BgLT. *5£«Si0> 
[OO2 0] **?T;}t&£*t*t<MlfcA2l 

[002 1] ip%. * 1 ©*Bfl>»»-ci*. ttro^i 

ttl=B«MM£4"tri=Ka t . SS 4 <7>§ISS0>R*©-T?I*. 
*MtSI=«*Mflt4><M=B«rr*. 
[0 0 2 2] iff. 1 ©SJ6fl>»flSl=OtxT 



[0 0 2 3] B 1 itm 1 <Z>3tfi£©}&Bl=«£KS«Si& 
[0024] S1 (a) l£S&«> KT*>4Ka>*5ft» 

a>B8ffl©«wi=»ia«BK«B*afflLfct,©-c*y 
(kit. . hi (b) itmmfs.%& 

izmmmmm&m.2mmLtzt,o>-ctbz> (bit. sisbs 

[0 0 2 5] HI (a) I=^**u4<fe5(=. S!*1SPS-C 
f*. •t©±fiPf=^rtffl J E-^ 1 A<ll**VTSy. 
TfiP(Cf*3O0>CCD*jt J 5 26<ES**l.T^4„ * €> 
(=. BMP 3. £*©*<»*SIS/<— v*-;ua>tfa.— 
* (Xl±^— ^X-r— V3 >) 4*<EE**tTL*-5. - 
(b) 1=3***1$* 3 1=. £»HE55B£!t.H*§ 

i=. ^©iwicjsrtffl*-* 1 *<EB£*vcfcy. 

TfflJ=l43O0DCCD*y ^ 2*<ffiB*4fCU^. * 

saws? 3. ±&0)®m2^i&'*— v+^3>ei- 

[0 0 2 6] Z<D«fc5C:, S 1 <7)Hte<D»fS0>Sffl«T? 

nrvr—i >a >l=£:h>ti"C. ffll=«fc-S®ABSEfl>^S: 
(=g-3 < SfSroBfflitffrfrih.* i: l=ft -5. 
[0 0 2 7] @2(±. £ 1 aXtta>»ffi(=ft«B«BBB . 

#t**3l=. *^7Sf*S-r-6HfliA*fiS1 iroai* 

I*. a$s««tijfflJi 2©a*(=s«*^. cobbjm* 
aasn 2<otB:&«4. ®7j is^Jtss i 3©A*i=^**t 

Tl^i>. ±IEH73lS]spJ5tffi 1 3 0>m*li. mfiSfiaitiSP 
1 4<DA*>C:&8e**u wOffiSPttathfiP 1 4<0ttl*i 
I*. ABJSISSP1 5 0AAl=lMfe*tTl*«. »=. 'C 

©A&st&ffli si*. e^it««i#fipi m tmmmmw- 

SH#fiP1 27bS1 5<0«-tti^Jl*. ^P«3ttl*ep 1 7 ©A* 

[oo28]ci©j:5 &mi$.<Dmwm.m®&&o>ftm$: 

-5 £: . 2fc<D «*: 5 1:: £ . 
[0029] "Ttf ilBBSlA^SP 1 1 I*. -OX 

y^yictetfrr-s. *?>i=. ®««SitiifiPi 2ii. &s 
«i=«LrH^rti=Sfi-rsA«8±ftro^fii«$«iai-r 

[0030] ±fE®fiP(aatbfiP 1 41*. sffl^icsiN 

T. 0i|S.lSl»Pll©iSSPi4*SdlL. -tti^WiStBII 
«£Slcffi<Dffi#A!>*#ScDIEJaft;£fr5. fit, ± 
1BA%Bltffll1 5 1*. &e.*ifciE&<b»H&£B#m*i]T? 

*t-C^-6#BA<D®©^®at^S^tt^L. 

[0031] Jii±©«aa-c?#?>*tfc!Ssi±Srta*a57 
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mfpf <* titcm&iz itmsmmm 1 8 1= as i\xn&. t u 
z>mm<r>m®it>mt>*i&. *tz. i©seki:i4. wen 

fiJ«S6»1 3*<=&A&©ei©rS]#£¥95£U gtiBtlcS 

[0 0 3 2] KIT. -t|B«-6M 1 7ig1 8l=«fc.5«i31£ 
[0 0 3 3] JtfBIS«AAS?1 1 I*. CCD*>5S¥I= 

fB«f-f ft. ±fBCC D*jt5©f»l*l OT?*,«fclAL 
tiafc-3-CtJ:<. «a©CCD*^?l=«fcoT«iyii 

2 rtM 1 s i= j: €>«ks$ **i**im y s-r c t izk& . 

[00 3 4] J:fiHS®lSE«lttai 1 2I±. M44>6'¥« 

i*fc*< e>«snB£#tf>*>c£i=«j:y. gts^tiiiates 

[0035] ±nmn&wz»-\ 3vit. ±tamm®m 
men 2i=fca^ttffl£*ifc±&««i=»u 

©ASKOfiH^ €> €> *tfc±TS*j*»3&: £®©*6) 
Uvci********. *fc»H¥0- l"'4 7119t 

oii-ca* & tix n * <fc 5 agaottc s«iai -r * 
[0036] ±i2ssp(aata® 1 4-ci*. *#s>*tfc<&si 

«»fl©ttHl*ail=ouxTI*. Xl» (*I#?OJ£. UUP 

«dij\ ST-m«a«^*iix» (d) . vol. jso-d 

■II. No. 8. pp2177- -2177 (1997) T?KW**ti>«fc 3 

[0 0 3 7] %i=tttt£4tfena«»aa>ttB£tti=. Of 

.[0 0 3 8] CC-V. B#fc£*8©»fl*<1*diU=< < 

[0 0 3 9] «i\t. Ai&SISSn *©ja3i£ 



[0040] cc-e. B3i*gi©«$agtiNR©-0!i£ij* 
[0O4 1] H3G>£Hl*. AABtt«at««tttflffil 

2i=«fco-c«Bsu»e.*vfcafi«isift^s9ij-eti'i<>a 

Mir— *£jj*Lfc=fc©T?fey. B3<7>£Hf*. B#5fc$U 

**to-5cti=«tyap»ffiH$tt^L. -eros**? k 

[0 0 4 2] £©SB#^[BII4. A&©H5t£fr?fc«>© 
MB**. A*B#rt©B©««i: LTfflJIl-f * c 

* 6Mfc L r l«fe.iW©B#&m * . A*M* & 

[ 0 o 4 3 ] *StJg©ffi*fin?l*. Blft*££ LTIi. £ 

(D) . V0I.J68-O. No. 3. pp345 -352 (1985)) 
B3¥9-2 5 .1 S 3 4^9ll=ffitt**t-Clv&:fflSffla- 

ffiB&eaiB-ft. 

[0044] «fc 5 tt**i-c« «fli ASrosfST 1 — 

* i4#9lgi: £lfcR-T£C fc-e. * jt 5( =< fc y»&$*i 

3 ^«nft-r«c c^-c. AM«MUii-r«Jt 

«*:<. lAIMt t^T 5 — -5K=»l6-r.6A«a4iS»J^ 

*- K-\>s#s?<D® Aitaic^fBrssMiT 1 -^ torn 

* iSxfcJS#(=Sa A1&4: Wft-T * C t l=«t*. 
[0045] ±ffig^if««»SP 1 6 14. A«s£H5t-f 

L^-tuK<oiaj#j . rBKtu«=<^«©fii#J tt^o 
[0 0 4 6] *fc. -A©A«J»c»LT«»ffl*-r*C 

[0 0 4 7]'±IB««W»»1 8 1*. A^igftSP 1 5 ic 

as i^Tfts a«j« <t aiai * *Lfcja#i= . aus 
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A*t-e £ * j: 5 1= l y * s t z t *<^if e> ft s . 
[oo4 8] *fc, a— K*>ejts#. bses^ @* 

fcA0DgSE*fr5«^l=«*. *ft-eft<&yU«a«>a— K-\> 

• 

[0 04 9] 3tel=*«w©sg2©SlS£a)^l^Sl=o^^■csi 

[oo5o] ffi2(ossiia>»ni=««aiHftsiRttB 
i*. m i ©Bte©®B0>BBi::i>ii*.T, ^<D*isi$}is 
L«t*«&BB»a>eB*fH^ aoB#ottiB*«ii^8i 
efteeBtu tgi^ia>i6j££»si=e&-f sbb£* 
*sj£ic«®A<fc*. 

[005 1] ca>m2<DHfi6(7)JBg|ro®ffl05l*3fel- 

m<J>Hfo *BB Lft# tfflp^g^fiia^^t^r RBI= 
[0 0 5 2] JUT, 05©7P- fV- l-£#fSLT, 

[OOS-3] H.-TBOmttt. 0<ThKTh2<D 

BBtffetta&T** 

[0 0 5 4] »«J=BB«*fiB L«fc 5 i: 
J/?CfA<l>llt#tlWBOS/XtAtBB+*. SB 
»ffliItA^SP1 1 Xl/XAffirtSB 1 7©Bl=3t-? 

#•5. .'. 

[0 0 5 5] H'4l=si*S*i*«fc5>3:Brtiaa 
BBA t &*F$&&o.' 
[o o 5 6] c©I3 4I=^**vS*5(=:. XrtJB^E— $ 
llcli, *^^2 2|c«fcyg«£;h.7=B«:i:, AftOB 

*<Bnn? £ fc *g 3^* tb a-r -s m& tbB*a« w 2 o 
*?«Bftmtt£BrtB2 1 £A<26jFS*v, **>«a&fc 

#«&*B©BBB#»6ft**3i=*»#**fcTi* 
* (X-r-y^S 1) . 

[0 0 5 7] Bl^T, A^72 2lC«fc*»HBfl>«iya 
**<fc£sfc (Xf^S2) , il&fr[6)0>f!l5£A<*T*3*t& 

Uf"^S2) . It, XMHttlBl 7 Tiffin Lfc 
7J 61 £ A l*Tg|£A<TT;h>ftT= An^A^JJS * *l5 (X-r 
»;^S4) . CICI^, *|*Lfc^A£A^Tj§«A<fTsb 

lfi]UT!i<S^7frftfcA*ofcia£(cl*, ^f-^S8i: 

[0058] xf-^s5 -cr*, mttfaomm&tfm 



£(DB<!Th1 J*lrt©^WCountl»fetBT? ^5A*A<«5££ 

(DB^CountTi&tijA^^fcia^lcl* (X^r-y^S 
5) , -t©73(oJA<eiaiL.§^Bro*l5J-eS>'5i:*«>t U 

(81 Count T?® til T?£&A^o7=S#(cl4gfi$l£$T3b"$*Icx 

[0 0 5 9] Xf!'7"S8'Clt. Br3£BBTh2El 

A<fcofcA^SA^«3t**v4. *LT» l5r5£BBTh2ei 

A<feofcS^I=l*jS»l= rM^BUi Ll= < t^Aj t U 
8ti:f»Lfcfti:xff7"S 7(c«fr-r-S (Xf-^ 
8 9) . C*U=**LT. Bf3£BfiTh2El±0)^raCount$ 
g®L-CtB®BSBdi1?#>S^73ia3A<^*^ofcJi#(= 
l±, ±8BB»BICountS-f >^U>>KLfcB. ±IEX-r 
?:7S2irR« (Xf9?S10) . ■ 
[0 0 6 0] C-5 LT, *-f Af- ^K»B7©rT5* 
«»rL (Xt^^S 7) WAf- ^»7i4ih.tf4 
T©gB£*S7U •B7LTl*>5:rt*Ui\ «ffl$-fAf 

— ^u=**5-i*rBrta*»i 7A*e>B:£isj<0»5r*--5 
1) . ±Bx???s2iniv. .tcBBoaBCBU 
[00 6 1] ci<D£5(cLT«B£ftfc«oA£<Dllt« 

[00 e 2] bp*., 1 Dij- wmmm^t 
£1=1*, S8»»i=SB*sh.t i»« r^sda lsi^Bo>:£ 

ISJJ £*JJHL, BI=BBMB*OB*Bttl-C*ftl^* 
A?> r^ffl L(= < U*Aj t U-Cg^*^T^«>73lSl*|S] 

us t^isi^jt® 1 3 -csKi**vfcJa^(ci* 
mu^-rt^Tjisjj sei<«»:5i=Xrtdi*spi 7i=-cit* 

[0 0 6 3] BcDTJlSlA^mS^SlU-haHbLftt^ 
JcL?tj;®Glzt,mi*itiil3U 1 7A^Bfjt*|SJ*lSj<J:5 

o fc^F iE * 5fcf*l8it-f * w i: A< Sim t U Z . 
[0064] *S6^a>m3<DXH£9jB®ico^-c 

[OO 6 5] £30£B0&£l=ft«BB£Stt£S 
tt..BBLfcBl©BB«»B©BBl=JD*r. BBB 
■^Saft*lsy*R51i^'Ect*l=33tNr(*, #S<D^S# 
^U-.^irRPfBr«AB0>BB«#34>. -AJU±W® 
SSB-e # fc i: # ©^Rlf mo>Uft * It rT-T * 1 1> o f=B 

te$*-r-&ji5i=^aA<fc«. B 

[0066] fSi, ^0»|g3(D|IBOi^8g<D®ffl««l*5tlc 

KMLfcBi tH»T?fcy, S*BJai=otNr=&Siro 
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[0 0 6 7] c©gs3©Sgte©«£®T<i*. 0 2©A«3B 
BtM satfBSfclttiesi 8V«filiclESA<JiDx.&ih.r 

#££BITe# *:££©*•. J9r5£©tH*©g*T3r£#;t£ 
J:5ftlSi|(ipA<ftS;HT^.&. 

[0 0 6 8] H«A*lffi1 11*14, *ga©#A< 

EB#l=l§f*T? # -S «fc 3 * * 3 fcfijffl UT $ «fc < . 
«a©*> 3 £BB LT^BtlcfflS* LT 4, J: 

[0 0 6 9] g«*flM8Sl#SM 6 1*. ±xa>§tm 

A«5©m Bani=. «-BA*<©3#©^#£ 1 &®i:-r-& 

[0O7 0] 61T, B6fl)7Q-f t- h£#fii!L"C» 
SI 3 ©HSg©B*§l(c&.5@IH&BBSgg(:: .fcSBBBB 

[oo7i] sKuaa^gate-r-st. i-c. 

ft*:ftfcA:fcB«rt©#A«5©SiSi£fr3 (X^r-v^S 
21) . IICT?I4. A*S«rt(=#«-#-S±-C<0Afe© 
BBBettUU «-BBft(=4e3-4-«Aft£.'SBS* 

an 6i=7A£B$*i-ci*snHii=&-3i*-ctt£-*-«. 

®fr*ST7fe**>SA^<!plBr*H-S (^f?7*S 2 
.2) . 

[0 0 7 2] ;©7f«;?S2 2i:fcUt, ©SStOI^ 
*#T?fc*£fWffS*ifc»£l=l4. A*® 
«*(=1ga*©A'K!lA<#«-t-&fr (Xf-y7"S2 3) , 

kit. cjh.*»a-r*. 

[0O7 3] ±EXff7'S 2 3l=r; A*H«*(=« 
B«©Att*n*SLftl*£«K*;|lfc«£lcl4. JgflM4 
J§g**t-5 (Xf7^S29) „ 

[0 0 7 4] ±IBX-r-y:7S 2 3 (=*5LnTA*®<S*(= 
ttft«0!>ABtf#£LTli*&ffK&llfe*l*l=J3l* 
T. Xfv^S 2 4l:fiUTfflt«)|»«tMtCitt 

Ttti^flBrS+ifcis^. B£oBBei±a>Aftfit#€ 

S 2 7l=tJLXT. BfSOaffla±©A»*<#ttL3tELxt 

9) . S«i:fl8r*^fcia^f=rt«lftA<ltW*^* <x 
f»;7s28) . 
[0 0 7 5] ±|»T97*3 2 4tttIfO^M 
fttttt-Cfc$£BK&:|lfe«*l::&lvC« Xf;^S2 

5 -i?&a«©+ i=sss*<#a l ft i> t mm <* Hfcis^ 



8) . 

[0 0 7 6] C©*5I=. Sl3<DllJfe<D»jS-ei4, 

ma&mt&mtt < *»eias;rvcu&A«jT?fc*tii— 

feT?&*tii«a^-a-i*Bgibftt^<Bfs©Aaiu±A<p^i= 
#«-r£*§£i=©*M§f*£i**r-f*. r»2©*— kj > 

UTS^**tT^S-fflO>A«l*<Sff L-C 
UtffOftBfttmrrs rB3©^E— Kj 1=16 ct. 

[007 7] *l=, **^©Ss4(0||J6«)»ISl=OLxr 

[ 0 0 7 8 ] ff 4 0SttOKS(=ff SttHtfcSHUftK ' 
14. SiaLf=Sf 1 <DHS6©»©©tSffil=*PS.T. ABa© 
C £ T?J!lr5£*i*£lT© A«a*<tH*£ L<fc 
5 £ Lfc£ #K8r^*i*ia±©#©|aj#*<&«>^i: 3* 
^JtS-T-S C 1 1= J: oTSBWf::i£ft©t<ra©4q|5££r 

[0 0 7 9] ft. ^©353©|t!g©«£8©aJB0«ll45fcl= 

MLfc® 1 £H«T?a&y. s*««r=oLxTtigi<o 
s«fi©»as(=j3UT»MLfc«sK-r*jiaia*n*H2 tra 

S#BLoo. #lMe£ASl::oi*<cffftf=Bn-*-«. 
[0 0 8 0] 4 ©££©»£(::'£ &BB&BBB 

ST?I4. A8)©4#5££f S&3EI4ft< . szmtzii-tfimis. 

•T?#+Llf<fctxfcto. @7l=**H-S<fc5(C. E20«73 
|S]«55SP 1 3 S.t/A^S^gP 1 5 A< % ^€tatttti«P 2 3 

atf*«*t£«2 4lcfi»**iT^.5. ft. ®&ArtfiB 
1-11*; «&**<Hi^icg»-e*-5J:5ftfl:ftft*/7 
i&fjffl Itt ctl^L, 8a© £RB LXHBlcB 

[OO 8 1 ] '*fc. BBffiBBftBl 6T?(4. 

bbotobbb. xani:#i»Ba>»Ba>MB*tK 
- l Mgirr * c 1 1= «fc o e> &*a$H<Df#a 

3l=BA<D4#«£iM#-f aSSSIifcgftl^ BA©^ffi 
»»*A*i*cfC, BAl=»r-5^iftifB*iE«tlcffi 
* v # * 1 1* o fc^s-e t US RiteT? c 
[0082] 61T. E8©7a— ^-v— h^#B§urs 
«4«>MBa>BBl=B«BBBBNttBI=J:«4i»BB 

[0083] aia^Mss-rst. ±ehbaa»i n? 

»&*ifcA*H«4>(=#«-r.*±T©A«s©ffiB«*a 
ta-T*. *LT. 2 2 1*. #®H»I=»L, 

S«ltffl«^fiP1 6l=^ift«lf3F+lf=^li$1t®$#BgL 

A!fe©*i&$ftS-r-5 Wf-;7S3 1) . 
[0 0 8 4] sftLx-e. Bf^UJ:54: tTk^BBAt. Br 
S^K6l±©|^##A<iBSftt©-e*-6^5Ax*<*flR* 
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*V«> (Xff^S 3 2). 

[oo8 5] -tur. Rfr3£^Kia±o>Pff#*<j&S'Ut 

ft A«8©* l=Bf £*8*UU:0>ft*<#£-f -5 *S*4<«lft 
**t£ (Xf.f^S3 3) . 

[0 0 8 6] Br3e^KKl±fl)#A<»eE-r*ttf» 
f^*<»Rl**v (x-r--V?S 3 5) . #«L£if;h.l£gHfc 

*<1§S**V«> Uf7?S3 4) . 
[0 0 8 7] w©«t5l=. t4©giW®T?l*. J5r5S 
*|*eU:<&E#«l*#ftfc < ftT?t.l§tt ft 1 

=e- h\ l=fcCTfttt©ftftv'l§5* t ftft**vciv.6. 

-tE^— ki*t ^ u ^— -> a xct: -a TaaasM^r^t? 
[oo8 8] mJiKBStfc*fiwi=<fc*iii. erFw&ft 

A<ft£*ti.. 

[0 0 8 9] (1) #S##^ft^lII=*JI+€)^S 

mwn~mm<j>mft& Ltz^tg-oxi^mmmmmmt 

nfp © A«J £ <til- BB#C:fta©BSIiE £frt V 
ft©ffl£tH= <fc o T ft5e©fttt©K *I £f £ - £ *<T? # 

*©fctf>. ftfc £©»<*£££#*<#*># 
fc<* &g<f£#©*e3i#*<l3#LTSII£fT;U*«fc 

Sftft*<fc£f=tf>(=ftftl::-:£©*!lfB£ It* - i: 6<T5I 
fttfc*. 

[0090] (2) *i*ftj£l=;fcl+i>3bft 
tiff * U <fc 3 £ L L Tt>4 A&©^IS£ ftffif * - <k 1= 

[0 09 1] (3) SfililCifcW-SiS&SI 

< * ©:fr|6]£|6] ^©S^ftHS £fx l^fctf ?> B 
<J>fo$&SHi?Z>ZfQs £<©75ia]£l6]L^=«IIift£ 
=fi&fr*ft&*<&<ftit>?>*u ftga<BB&©g«S£ 
"T 3 c: *f=gtiB#|::-5£<«*>B©Si&:6< 

i* a t? # & t ^® ©7* is] & o fc e> ft a © £ J* -r s*ft 

[0 0 9 2] (4) HtgHirfclt-saiS 
SliE©^i=0r5S^i6]*ifi]txr=t,t.^, silrofticiaiAM* 

£xf= y«ft73lS]^ iSl/MiS - tic* oT?S 



i^B*i=ftSLTfe£B©*sa©uj-\*-ri^iaK tai=<^ 
*ia] *ft AjMicfco c t ic«fc o xmm&^Mmm^i- * 

[0093] 

[SSW©8lft] **WI=«fc;fcfi. SBEI^(=*Jlt*^iEff 

s*i»jtL. gfcft©BBft&Ki£sgsi-f4SiBftsia 
seai/ftHftgffii*^*ftflt-r * c t *<-c#*. 

[BB©fSftfcBWB] 

[H1] (a) l*ftB©K7^$J*©«fc5#ft©BaBl© 
SWlcft 1 <D»ft©»»l=«*MH«BMMift*affl L, 

fc«^ro*fit**-ria-cfey. <b> i*s»iB£^fti=s 

1 0£ft(Dftttl=ft SftHftSttftftSftH Lfc«£© 

ftj*£*f0-e&s. 

m 2] ft 1 (DftttoftSi=ft«HBfte»ftfta>ftft 

[B 3 ] ft 1 a>BttO>»Bl=ft «BBBBMttSI=Ttt 
[04] ft2 0fttt®Bfil=ft«ftBftSKSftl=J:&. 
[B5] ft2©ftft©fl2ft(::«.SlSgIiIftS18Sgg(::*S 

mm «©«»«&*= oixtbsm- 5fcft®7D-f+- 

[B6] ft3©ftft©J&Sg(c«-&BBft&BM£gl=«fc6 
SSEftSKo i*-c»a*: * tz sb © v a — t ■* — f- x- fe 
*. 

[0 7] ft4©fttt©»ftl=ft&BBft&Kttft©ttft 
[B8] ft4©ftft©fl£ft(::ft-&.BBftffiBM£ftl=«i:*> 

[»^©SiW] 
1 ftrtft^E-^ 

2 

3. ,• BBft 

4 /<— V^-;Ua>tfa.— ^ 
1 1 BftAfcft 
1 2 Bft^fttllft 
1 3 H*GJffl56«! 

1 4 iafipeamsp 

1 5 A&SSSfift 

1 6 S@1tftft1$ft 

1 7 ftwai^ft 

1 8 gtS«]«ft 



(9) 



2001-256496 



[013 



[02] 



1 Sft 




2 M 




(a) 



4 PC 

<* ft tt Workstation) 



-11 



g^feag K 12 




[H3l 



[05] 



ED 



vCpunW) V 



sfliir 

CountaQ . 



>S2 




S11 



C B&5S7 J 



21 a^- 




22 */5 



[06] 



JL 



22 




QgfEPlE5> -S29 



(10) 



O 01-256496 



[17] 



[138] 




1 Aft— rtWftAttW^iWtt ^ 631 




CD 

rn 
—i 

I 

m 
o 

o 

3. 



